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Detection and recognition of objects by multispectral sensing 



FIELD OF THE INVENTION 

5 The present invention relates to a method and a system for detection and 

recognition of objects by multispectral sensing 

BACKGROUND OF THE INVENTION 

Various approaches have been used, for example, for passive remote sensing 
of the ground. Thus maps of surface brightness, temperature and emissivity have 
io been used for investigating geological surface properties (Kahle et al. 1980, 
Applied Optics, 19, 2279), whereas maps of thermal inertia have been used to infer 
subsurface properties of soil (Price, 1977, Journal of Geophysical Research, 82, 
2582). 

EP-A-O 143,282; EP-A-O 420,108; and U.S. Pat. 5,377,126 disclose 
15 various approaches for remote determination of emissivity and temperature of an 
object. The determination was performed by measuring the multi-spectral 
electromagnetic radiation and applying various models, which provide dependence 
of emissivity on wavelength and temperature by solving a set of equations, which 
include emissivity and temperature as parameters. As such, these approaches enable 
20 to obtain the object's temperature and emissivity in various cases, including that in 
which these parameters vary in time. 

The detection of underground structures requires penetration of the ground 
and is therefore accomplished by active sensing techniques, such as radar (Blake, 
1993, "Ground-Penetration Radar Developed by Sweden," International Defense 
25 Review, 3, 193; von Maydeil et al, 1987, U.S. Patent 4,675,677), or combined 
passive sensing and radar (Clark et al, SPES - The International Society for Optical 
Engineering, 1942, 178). 

It is acknowledged in the prior art, that emissivity of various 
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materials may noticeably depend on wavelength of the emitted radiation and 
temperature of the sample. 

For example, US 4,659,234 describes a method of emissivity error 
correcting for radiation thermometer, where temperature is determined based 
5 on two measurements of radiated infrared energy at two closely adjoining 
wavelengths, and the result is corrected using one single measurement. While 
the method is aimed to solve a problem of determining the randomly changing 
value of emissivity of heated metal objects, it does not take into consideration 
any dependence of emissivity on the radiation wavelength, and much less - on 
io temperature of the object. Such an approach renders the method inaccurate. 

US 5,132,922 describes an emissivity independent 
multi-wavelength pyrometer operating according to a method using a 
least-squares-based multiwavelength pyrometry technique and a theoretical 
function for the dependence of the radiance on the wavelength. However, in 
is this method the emissivity/wavelength function is considered to be the same 
in all spectral bands, which either leads to a significant reduction in the 
accuracy of the determined temperature, especially for heated non-transparent 
materials, or to the use of narrow-band filters. The latter poses a problem for 
infra-red measurements in real time, since narrow band filters provide 
20 insufficient energy for further processing. 

Moreover, all the described above methods make an assumption 
that emissivity of an object is independent of its temperature, since none of 
the methods appear to suggest any way of considering this dependency for 
determining temperatures. Such an assumption inadvertently leads to essential 
25 errors in the temperature determination for at least non-transparent heated 
material. 

In many branches of industry, for example in metallurgy or in 
manufacture of semiconductor devices samples and materials are exposed to 
various operations while being in the heated condition. 
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Determining temperature of such objects during the manufacturing 
process presents a very important task, which is rather difficult due to the 
following factors: 

- it is impossible to perform direct temperature measurements, so 
5 the temperature determining is usually performed via the remotely acquiring 

data on the infrared radiation of the sample and further processing this data, 

- in the mathematical processing of the remotely obtained data 
many parameters intrinsic to the material of interest must be used (such as its 
thermal emissivity, etc.), which are usually unknown and cannot be directly 

io measured. 

Another important task is detection (usually in the dark) and 
recognition of various objects having different temperatures and/or 
emissivities. Difficulties of such a process are essentially the same as outlined 
above. 

15 

SUMMARY OF THE INVENTION 

It is therefore the purpose of the present invention to provide an 
accurate method of remotely determining temperature and/or emissivity 
function of objects. It is to be noted, that the problem of determining the 
20 emissivity function of real objects is one of important problems in many 
industrial applications. 

Another objective of the invention is designing a system for 
implementing the above-mentioned method. 

Yet another objective of the present invention is to provide a 
25 method and a system being capable of detecting and where applicable, 
identifying objects on the basis of remotely determined temperature and 
emissivity distributions. 

A specific objective of the present invention will be to provide a 
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real time recognition of objects (usually in the dark) from a movable platform, 
using the inventive method. 

The term "object" is used herein in a broad sense to denote any 
kind of structure, crop or articles in a solid, liquid or gaseous state on the 
5 ground, natural and artificial underground structure, as well as objects located 
above the ground (such as solid samples, oil spots on water, clouds, overhead 
electric wires, etc.). 

For the sake of simplicity the term "object detection" will be used 
in the following description and claims to denote the detection of an objegl or 
io ob jects or of some properties thereof. 

The above main purpose can be achieved by providing a method 
of remotely determining temperature of an object, comprising: 

- acquiring electromagnetic radiation data from the object in N spectral 
bands, 

15 - deriving temperature value from said data using a system of equations, 

each describing the electromagnetic radiation that is emitted from the object 
in said band as a function of temperature and emissivity of the object: 
the method being characterized in that, 

- said electromagnetic radiation is measured M times, each time in N 
20 said spectral bands, thus obtaining N*M readings, 

- a system of N*M equations is formed, each describing the 
electromagnetic radiation that is emitted from the object in said band as a 
function of temperature T and emissivity s of the object, wherein the 
emissivity s is described by a model incorporating at least one function, of at 

25 least two arguments being temperature T and wavelength A.; said system 
comprising N*M readings of the electromagnetic radiation and at least M+P 
unknowns which include M values of the object's temperature corresponding 
to said respective M measurements of the electromagnetic radiation and P 
parameters, wherein P > 2; said parameters belonging to said model of 
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emissiviry; 

solving said system of N*M equations, thus deriving temperature 
of the object at any one of the M moments of said electromagnetic radiation 
measurement, wherein M is a natural number of the set [1, 2, 3.. .]. 
5 According to one particular version of the above method, the 

mentioned model is selected to comprise one function s - f (XT) taking 
constant values within respective spectral bands, and therefore P is considered 
equal to N, 

thereby said system of N*M equations is formed to comprise N*M readings 
io of the electromagnetic radiation and N+M unknowns which include M values 

of the object's temperature corresponding to said respective M measurements 

of the electromagnetic radiation, and N values of emissiviry for said 

respective N spectral bands. 

The above-defined particular method is based on the following 
15 assumptions; 

1. Emissiviry of the object in each one of the N spectral bands is a 
predetermined function of temperature having parameters which are constant 
during all the M measurements of the electromagnetic radiation performed in 
this band. 

20 2. During each specific measurement of the electromagnetic 

radiation, temperature of the sample is assumed to be constant (i.e. its change 
is considered negligible), regardless the spectral band where such specific 
measurement is performed. 

The assumption 2 is best fulfilled if each measurement of the 

25 electromagnetic radiation is performed in all N spectral bands substantially 
simultaneously. It is especially important for accurate measurements 
concerning objects which undergo either heating or cooling. For an object or 
a plurality of objects which have rather constant or slowly changing 
temperatures, the measurements in N spectral bands may be accomplished in 
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sequence, at a maximally available speed. 

In practice, i.e. when digital computing technology is used for 
controlling the process of measurements and processing the obtained data, 
each of said M multispectral measurements of the electromagnetic radiation 
5 (i.e. each of said M*N readings thereof) is digitized and stored in a computer 
memory for further computerized processing, said processing comprising 
substituting the digitized M*N readings of the electromagnetic radiation into 
said M*N equations, and solving thereof. 

Dro f»»»o V\\i i tK» oKai/o fnaocn re*rr\ pntc qtp tr\ Kf» nrr\\ridf*f] in th f 

10 infrared spectrum. 

According to one specific version of the method said equations are 

integral ones, for example Fredholm equations relating to emissivity. 

It should be emphasized, that the above-defined method easily 

provides sufficiently accurate temperature values both in cases when 
15 emissivity of the object essentially varies from one spectral band to another 

(either due to dispersion between these bands, or due to specific physical 

properties of the object), and in cases when the emissivity is rather uniform 

throughout the spectrum. 

In addition, a succession of temperature values obtained by the 
20 method can be used for real-time monitoring and controlling of the object's 

thermal condition, for example during a technological process to which the 

object is subjected. 

It is well known, that at high temperatures (i.e. those between the 

room temperature and 1,500°C) emissivity of some real materials, such as 
25 semiconductor samples, varies not only from one spectral band to another, but 

also depends on the temperature of the sample. One of the reasons for such an 

effect is degrading of the sample's transparency with the temperature increase. 

that consequently affects emissivity of the sample. In other words, the 

simplest case of assumption 1 mentioned above is not applicable to such 
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objects. and. when temperature of heated non-transparent objects must be 
determined, the method where only N+M unknowns are sought for will not be 
sufficiently accurate. It means, that if the sample emissivity is considered to 
be independent from temperature while the sample undergoes any thermal 

5 treatment, this assumption will be a source of essential errors in calculations 
of the temperature. 

Having assumed, that emissivity of the heated sample is a known 
mathematical function of temperature and wavelength with unknown 
parameters, the inventors suggested to introduce such parameters as 

io unknowns into the above-mentioned system of equations, in order to obtain 
values of the parameters by solving the system. 

More particularly, each of said M*N equations describes the 
electromagnetic radiation that is emitted from the object in one of said bands 
as a function of the temperature and the respective emissivity of the object, 

15 the emissivity, in turn, being a known function of temperature, wavelength 
and a known number of unknown parameters; said parameters being 
introduced as additional unknowns into said system of equations for further 
obtaining their values upon solving the system. 

In one example, the mentioned known function may be 

20 represented as a sum of a known number of terms of two other functions, a 
first of which being dependent only on temperature and a known number of 
unknown parameters, and a second - only on wavelength and another known 
number of other unknown parameters. 

According to another example, this known function may be 

25 represented by a polynomial expansion having K unknown coefficients, said 
coefficients being introduced into the system of equations as unknown 
parameters to be determined among said unknowns upon solving said system. 

If the emissivity variable in each of the above mentioned equations 
is represented as a polynomial function having K unknown coefficients, the 
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system of the equations will overcome some transformations. Namely, though 
the number of equations N*M is unchanged, the number of unknowns in the 
system will increase and become equal to M + K*N. where K is the number 
of polynomial coefficients of the function emissivity/temperarure in each of 
5 the N spectral bands. However, if the numbers of the polynomial coefficients 
are different in different spectral bands (which case is more general and more 
correct from the physical point of view), the number of unknowns in the 
system will be M + (K 6l + K a2 - ■■+ K a n), 

where K^i ...K a n are numbers of the polynomial coefficients of the 

io eniissivity/temperature function in each of the spectral bands, respectively. 

In practical applications, where the electromagnetic measurements 
are performed and processed by the aid of computer, the number of 
electromagnetic radiation measurements M and the number of spectral bands 
N may be as great as is wished. For example, in industrial conditions during a 

15 relevant technological process up to 2,000 measurements may be performed 
in a short period of time, each measurement taking from 1 to 10 msec. On the 
other hand, the number K of polynomials in the function emissivity/temperat- 
ure usually does not exceed 4. Owing to that the system of such equations is 
solvable, since 

20 N*M»M + K*N, or 

N*M » M + (Ka, + K A2 -+ K AN ). 
The most effective application of the above described modified 
method is for non-contact temperature measurement of heated non- transpar- 
ent objects, for example of semiconductor materials and samples during their 

25 manufacture. 

It should be emphasized, that, since values (parameters) of the 
emissivity function are solutions of said system of M*N equations, as well as 
the temperature values are, the disclosed above method of remotely 
measuring temperature of an object constitutes also a method of determining 
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the emissivity function of the object. 

In other words, there is provided a method of remotely 
determining emissivity function of an object, comprising 

- acquiring electromagnetic radiation data from the object in N spectral 
5 bands in the infrared spectrum by measuring it M times, each time in N said 

spectral bands, thus obtaining N*M readings, 

- forming a system of N*M equations, each describing the electromag- 
netic radiation that is emitted from the object in one of said bands as a 

1UIII.LIU11 \JX. IWUipMUtUlW A 1411 VI VllliJJl * 11JT C. »• UUjVWfcj "iivivill uiw 

io emissivity s is described by a model incorporating at least one function, of at 
least two arguments being temperature T and wavelength a; said system 
comprising N*M readings of the electromagnetic radiation and at least M+P 
unknowns including M values of the object's temperature corresponding to 
said respective M measurements of the electromagnetic radiation, and P 

15 parameters, w herein P > 2; said parameters belonging to said model of the 
emissivity: 

- solving said system of N*M equations to derive said P parameters, 
thereby reconstructing the emissivity function of the object. 

All the above-described modifications of the method for 
20 determining temperature are applicable to the method for detemiining 
emissivity, mutatis mutandis. 

It should be appreciated, that the above described methods for 
remotely determining temperature and/or emissivity function of an object may 
be utilized for deriving temperature and/or emissivity descriptive maps of the 
25 object. 

To the above-mentioned purpose, the object is to be divided into a 
plurality of representative segments, and each segment is to be investigated 
according to the above-suggested technique. The processed data on the 
temperature and/or emissivity function associated with each specific segment 
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of the object can then be used for forming a corresponding pixel of the 
respective descriptive map. 

As has been mentioned earlier, "the object" is defined in a broad 
sense, so it can be understood as a plurality of so-called sub-objects having 
5 different temperatures and/or emissivities and dislocated in a selected region 
which limits the object in space (for example, the sub-objects being such as 
the ground, the space above including one or more articles, the surrounding 
atmosphere in the selected region). Consequently, when the object is divided 
into a plurality of representative segments, in most cases the sub-objects will 
10 not coincide with the representative segments, for example one sub-object 
may be covered by a number of segments and should be thereby represented 
by a number of corresponding pixels. 

Further, the above-described method can serve for the object 
detection on a background of the ground and/or the surrounding atmosphere 
!5 in a selected region. For this purpose, the method may additionally comprise 
the following steps: 

- acquiring meteorological data indicative of climatic conditions of the 
selected region on the ground and/or the surrounding atmosphere: 

- recording the acquired electromagnetic radiation and meteorological 
20 data by means of suitable data recording means; 

- storing the so-recorded data in suitable data storage means and 
deriving from the so-stored data, descriptive maps of the selected 
region; and 

- feeding data of said descriptive maps into pattern recognition 
25 processor means to classify the pixels of said maps of said selected 

region, whereby the desired object detection is achieved. 
By one embodiment of the invention said meteorological data are 
obtained from meteorological stations. 

Typically the said descriptive maps are temperature, emissivicy and 
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albedo maps. Albedo is a parameter which can be defined as follows: 
A = ^- 

where. r v is the radiation measured by the radiometer in the visible and near 

5 infra red regions; Tv , is the atmospheric transmissivity in the visible and near 
infra red regions; r fl , is the optical transmissivity of the radiometer including 
the transmissivity of the spectral filter in the visible and near infra red regions: 
and Ws is the radiation from the sky. 

According to one embodiment of the invention applicable in cases 

io where the objects detection is based on pronounced temperature and/or 
emissivity differential between the representative segments of the object, the 
object detection according to the invention is based on a single scanning pass 
of the selected region (i.e. M=l). This embodiment of the invention may be 
applicable, for example, to the detection of overhead high voltage wires, 

15 defects in the wires, connectors and insulators, or diseases in crops. In the 
performance of this embodiment the descriptive maps describe temperature 
and emissivity and the pattern recognition processor means classifies the 
pixels according to temperature and/or emissivity difference. Typically, the 
emissivity map is used by the pattern recognition means in the classification 

20 process. In the case of overhead high voltage systems for example, any such 
local temperature increase denotes a possible defect in the inquiry sector 
thereof 

If desired, the emissivity map can be used to remove background 
noise, hence enhancing the temperature differences of the object under 
25 investigation. This is done by using die emissivity map to identify those 
pixels belonging to the object under investigation. Any temperature 
differences belonging to the background are then eliminated. 
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According to another embodiment of the invention the object 
detection is based-on multiple scanning passes at desired times (M=2. 3. 4..,) 
and said descriptive maps describe temperature, emissivity and albedo, 
wherefrorn a set of characteristic maps of the selected region are derived by 
5 incorporating suitable reference data. 

Typically an optimal set of characteristic maps of the selected 
region is chosen and data thereof are fed into the pattern recognition 
processor means in order to classify the pixels of said optimal set of 
characteristic maps of the selected region, whereby the desired object 
jo detection is achieved. The set of characteristic maps may comprise maps of 
thermal inertia, thermal flux, coefficient of heat transfer and coefficient of 
mass transfer. 

The scanning of the selected region for measuring electromagnetic 
radiation in a number of spectral bands may be effected either by remote 

15 scanning or by close range scanning. 

In general, the pattern recognition processor means first defines 
the number of classes that the selected region is to be divided into. It then 
divides the selected region into the defined number of classes by statistically 
associating each pixel of the characteristic maps with a given class. Although 

20 the classes are not necessarily identified with areas having different physical 
properties, e.g.. areas of water, rocks, vegetation, sand, soil, etc., there should 
be some correlation between the two for the process of associating the pixels 
to each class to be successful. For a given selected region there exist 
preliminarily determined universal reference data that are required in order to 

25 evaluate the characteristic maps. The values of the reference data are obtained 
in controlled experiments as described below. It has been found that sufficient 
accuracy can be obtained in the detection process by using an average set of 
univ ersal constants. This set is derived by taking the average value of the set 
obtained for ground relative humidities less that 12% and that obtained for 
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ground relative humidities greater or equal to 12%. The term "universal 
reference data" indicates that, to a good approximation, the reference data are 
suitable tor all kinds of backgrounds and objects. In the advent that greater 
accuracy, with respect to the ground humidity, is desired in the detection 
5 process, the universal sets from which the average set was derived can be 
used, depending on the humidity of the ground. 

When the object detection according to the invention aims at 
detecting below ground level characteristics of the selected region, e.g. at 
finding underground artificial structures, geological structures holding 

to deposited minerals, etc.. the underground structure of interest will then show 
up as an anomalous pattern in the pattern recognition process, due to the fact 
that the heating and cooling processes of the ground are different in the region 
of the underground structure as compared to the surrounding region which is 
absent of such underground structures. In other words, the pattern recognition 

15 means will not be able to associate those pixels identified with the 
underground structure with one of the defined classes. 

In general then, object detection entails pixel classification, in 
which a number of classes is defined and the pixels in the selected region are 
statistically associated with the classes. To this end a quality function is 

20 defined and the pattern recognition process entails determining that set of 
characteristic maps that maximizes the quality function. Anomalous patterns 
are those in which the pixels cannot be associated with a given class in the 
selected region. Where possible, it is preferable that the pixel classes 
correspond to areas having well known physical properties. 

25 Although the reference data can be considered as universal, more 

accurate values can be used if desired. Values for the reference data for 
different backgrounds or objects can be obtained by measuring the radiation 
from a reference sample of known emissivity. of the background or object of 
interest, at predetermined times and at the same time directly measuring the 
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temperature thereof. The reference data can then be derived from the 
measured data by utilizing an energy balance equation. 

By one embodiment of the invention the remote scanning of the 
selected ground region is performed with at least five sensors operating. 
5 respectively, in the 3-4 ^ 4-5 ^, 8-10 u, 10-12 u and the near infrared and 
visible spectral bands, and there is provided at least one further sensor for 
measuring electromagnetic radiation from the space above, operating in the 
0.4-2 jj, spectral band. 

Quite generally, the characteristic maps of the selected region 
io include maps of thermal inertia, thermal conduction flux, coefficient of heat 
transfer, coefficient of mass transfer, and the mean, variance and texture maps 
derived therefrom. However, if the relative humidity of the ground in the 
scanned region is greater that 30%, these maps cannot be computed. 

Preferably, the said classifying processor means in which the 
15 pixels of the characteristic maps of the selected region are classified into 
classes, makes use of a poly-Gauss expansion to describe the statistical 
distribution of the pixels and Bayes r method to sort the pixels into classes. 

For the said evaluation of the sets of characteristic maps for the 
purpose of selecting therefrom an optimal set, the said pattern recognition 
20 means comprises quality factor evaluation means and the pattern recognition 
process entails determining a set of characteristic maps for which the quality 
factor is the highest, thereby giving rise to the best pixel classification. 

The pattern recognition means can also include additional 
geometrical classification means for determining the shape of the detected 
25 object. 

Still further, the method can be specifically adapted for real time 
temperature/emissiviry mapping of a plurality of selected regions to be 
observed, in said method the step of acquiring said electromagnetic radiation 
data is provided in real time by equipment mounted on a movable platform. 
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while displacing along said plurality of selected regions; wherein the steps of 
recording and storing the acquired electromagnetic radiation and meteorologi- 
cal data and further deriving from the so-stored data, descriptive maps of the 
selected region are registered (i.e. aligned) with the platform displacement. 
5 It is understood, that the above method may include automatic 

recognition of objects positioned along or on the course of the moving 
platform, such as a vehicle. Still further, the method may comprise steps of 
initialing an alarm and optionally, of automatic adjusting the course of the 
vehicle whenever an obstacle is recognized. 

10 

In accordance with a further aspect of the invention, there is 
provided a system for remotely determining temperature and/or emissivity 
function of an object, said system comprising: 

scanning means for acquiring electromagnetic radiation data from 
15 the object M times, each time in N spectral bands, thus obtaining N*M 
readings of the electromagnetic radiation, wherein M is a natural number of 
the set [1,2, 3 ...]; 

means for recording and storage said N*M readings in the digital 

form; 

20 computational means for processing said N*M readings of the 

electromagnetic radiation as a system of N*M equations comprising M 
unknown values of temperature and at least P unknown parameters, wherein 
P > 2; said parameters belonging to a model of the objects emissivity. the 
model comprising at least one function of at least two arguments being 

25 temperature T and wavelength X\ 

display means for displaying one or more of said unknowns 
obtained upon solving said system of equations, or derivatives therefrom. 

The above system for remotely determining temperature and/or 
emissivity function of an object can serve for deriving temperature and/or 
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emissivity descriptive maps of rhe object, if said scanning means are capable 
of acquiring the electromagnetic radiation from a plurality of representative 
segments of the object, and said computational means are capable of 
processing the acquired data, for deriving and displaying the temperature 
5 and or emissivity descriptive maps of the object by the display means. 

The scanning means may comprise a plurality of sensors capable 
of simultaneously measuring electromagnetic radiation in a number of 
spectral bands. 

In another embodiment, the scanning means may comprise a 
io spatial optical filter divided into a number of sites for simultaneous acquiring 
the electromagnetic radiation from said plurality of respectively located 
segments of the object; each said site having N zones responsible for splitting 
the radiation acquired by the site into N spectral bands, thereby acquiring the 
electromagnetic radiation in all N spectral bands simultaneously. The splitting 
15 can be provided by chromatic beam splitters. 

According to an alternative embodiment of the invention, the 
scanning means comprise a rotatable optical filter for acquiring 
electromagnetic radiation in said N spectral bands in sequence, and at least 
one infrared sensor. 

20 If desired, said sensors are capable of remote scanning. 

Alternatively, the sensors may be designed for close range scanning. 

By another embodiment of the invention the scanning means 
comprises at least five ground oriented sensors operating, respectively, in the 
3-4u. 4-5 u ? 8-10 10-12 ji and the near infrared and visible spectral bands 
25 and at least one space oriented sensor operating in the 0.4-2 (i spectral band. 

In the preferred embodiment, the system is capable of object 
detecting in a selected region having a background including the ground 
and or the surrounding atmosphere, further comprising: 

- means for acquiring meteorological data indicative of climatic 
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conditions of the selected region and the surroundings; 

- means for recording said meteorological data; 

- data storage means for storing the recorded meteorological data 
(possibly the same means as for storing the electromagnetic radiation data); 

5 - computational means for deriving from the stored 

metheorological data and the data on the electromagnetic radiation, 
descriptive maps of the selected region; and 

- pattern recognition processor means for classifying the pixels of 

said maps. 

io By one embodiment of the invention said means for acquiring 

meteorological data are associated with meteorological stations. 

In accordance with a preferred embodiment of the invention said 
computational means are capable of deriving from said descriptive maps a set 
of characteristic maps. In such an embodiment the said processor means 

15 preferably comprise optimizing means for selecting an optimal set of 
characteristic maps which is subjected to pixel classification. The pattern 
recognition processor means can comprise pixel classification means in which 
a number of classes is defined whereby the classified pixels are statistically 
associated with the classes. For example, the pattern recognition processor 

20 means can function based on a poly-Gauss expansion for determining the 
statistical distribution of the pixels, and means based on Bayes' s method for 
sorting pixels into classes. The pattern recognition processor means may also 
comprise quality factor evaluation means. 

According to one specific embodiment of the invention, the 

25 pattern recognition processor means includes additional geometrical 
classification means for determining the shape of the detected object. 

In a specific embodiment of the invention, the remote sensing 
equipment and the data recording means are positioned on any movable 
platform (for example, are airborne), whereas the data storage means, 
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computational means, classification means and pattern recognition means are 
on tiie ground. Alternatively, in some embodiments the remote sensing 
equipment, data recording means, data storage means, computational means, 
classification means and pattern recognition means may all be positioned on a 
5 movable platform (or, in a particular case, be airborne). 

In the above embodiments, said computational means are adapted 
to stabilize and register the recorded and stored data of the acquired 
electromagnetic radiation with the platform's movement to obtain a real time 
mapping and pattern recognition. 
io It should be appreciated, that pattern recognition processor means 

can be capable of automatic recognition of objects positioned along or on the 
course of the moving platform, and if necessary, of initiating an alarm and 
automatic adjusting the course of the vehicle whenever an obstacle is 
recognized. 

15 It goes without saying, that in the embodiments where the system 

enables the descriptive maps and the pattern recognition to be accomplished, 
the display means are capable of displaying the appropriate output data. 

BRIEF DESCRIPTION OF THE DRAWINGS: 

20 In order to understand the invention and to see how it may be carried 

out in practice, a preferred embodiment will now be described, by way of 
non-limiting example only, with reference to the accompanying drawings, in 
which: 

Figs, la and lb present a flow-chart of the algorithm illustrating a 
25 method of non-contact temperature measurement according to the invention. 

Fig. 2 is a flow-chart of a modified method based on that illustrated in 
Fig. lb. 

Fig. 3 is a block-diagram of a system implementing the inventive 
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method. 

Figs. 4a and 4b are schematic plan views of two embodiments of the 
filter shown in Fig. 3. 

Fig. 5 is a block diagram of the process for determining the character- 
5 istic maps of the region selected for scanning. 

Fig. 6 is a block diagram of the pattern recognition process. 

Fig. 7 is a block diagram of a system according to the invention for 
performing non-contact temperature/emissivity measurements and pattern 
recognition. 

io DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Before relating to the drawings, some basic terms and indications 
of constants and variables are to be introduced, which will be used further 
below in the examples of the inventive method. 

In the case, when the method is applied to detecting and 
t5 recognizing objects on or above the Earth's surface, a multi-spectral scanning 
means (e.g. radiometer) scans the area of the surface under investigation at. at 
least one pixel at a time. The radiation received from each pixel by the 
radiometer, and by a pyranometer which receives radiation from the sky, 
serves as input for processing means which computes descriptive and 
20 characteristic maps of the selected region. The processing software is based 
on the Planck's equation: 

IF* $T ( (A)r Q (A)e(A,T)B(t,T)dA+ \r A {X)r Q W{\-E{X y T))J{XJ s )dX (I) 

w here the integral is over the spectral region of the sensor under consideration 
25 and where: 

W is the radiation received by the radiometer, 

tj( a ) is the spectral atmospheric transmissivity which can be obtained from 
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standard sources (Wolfe and Zissis, Editors, 1993. The Infrared Handbook - 
revised edition. Environmental Research Institute of Michigan. U.S,A.; Selby 
et aL 1978. Atmospheric Transmirtance/Radiance: Computer Code 
LOWTRAN 4, report no. AFGL-TR-78-0053. Optical Physics Division, 
5 Project 7670. Air Force Geophysics Laboratory, Hanscom AFB, MA. USA). 
i j /. ) is the spectral optical transmissivity of the radiometer including the 
transmissivity of the spectral filter, which can be measured by standard 
methods. 

e(/..T) is the emissivity of a pixel in the selected region, 
io T is the temperature of a pixel in the selected region, 

B( k.T) is the spectral radiance of a black body at surface temperature 7\ 

(for the definition of B(A,T) see - Bramson, 1968, Infrared Radiation - A 

Handbook for Applications. Plenum Press) 

7\ is the sky temperature, and 
is J( s> . r, J is the sky spectral radiance which is given by B(A t T s ), where a 

possible choice for j t is T s = T a -10 °K . and where T„ is the temperature of 

the atmosphere in the vicinity of the selected region. 

The method will be further explained for a simplified particular 
20 example, e.g. for an object consisting of materials homogenous from the point 
of view of radiation parameters. 

Radiation of the object includes three components: 
W= Wl + 02+ W3 
Wl = s*W B 

25 W2 = R *Y 

W3 = tr *G 

where: 

W • total radiation of the object received by the radiometer 
Wl - radiation emitted by the object 
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W2 - radiation reflected by the object 

WS - radiation transmitted by the object through its body 

e - emissiviry coefficient of the object 

R - reflectance coefficient 

tr - transmittance coefficient 

(l=tr + R + e y 

W B - radiation of the black body having temperature equal to that 



G - radiation existing at the back side of the object 

background radiation arriving to the object. 
For a non- transparent object (having tr = 0)» which is heated to a 



relatively high temperature with respect to the ambient one. both W2 and W3 
are equal 0. 



t5 represented by a formula (2) derived from the general (Planck's) equation ( 1): 



i.e. taking into consideration that x a and x o are equal 1 and all members 
concerning atmosphere and sky are suppressed. 

For determining intensity of infrared radiation emitted from the object, a 
20 reference body can be selected, for which there are known its radia- 
tioa/temperature dependencies in each predetermined spectral band. 

A radiometer can detect radiation of the object in several spectral bands. 
In a specific spectral band, the received radiation V may be represented by a 
Fredhoim equation (3): 



of the object 



In this case radiation W in the spectral band Ai = [k\, X 1 ] can be 




(2) 




(3) 



25 
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where 



(p l (/0- function dependent on the radiometer's parameters for specific band "i 



11 



and on transmitting properties of the atmosphere* 

If the radiation measurements are performed M times (L.j...M), and 
5 each time in N spectral bands (L..L.N), simultaneously (see blocks 1. 2, 3 in 
Fig. la), the following system of (N*M) equations may be built and solved: 



Solution of the above system of equations will comprise M values 
of temperature (Ti„Tj..TM) and, (in this simplified case), N values of 
io emissivities (ei.» £i,..£N) as can be seen from both the equations (4) and Figs 
la, lb ( blocks 4, 5, and 6). 

Fig. 2 illustrates another final portion of the flow-chart, which, 
together with the flow-chart diagram shown in Fig. la will form a general 
algorithm for cases when the object's emissivity depends both on wavelength 
15 and temperature. The system of equations processed in block 7 of the general 
algorithm is more complex than system (4) (see also block 5 in Fig. lb), 
namely: in each of the N*M equations dependence of the emissivity variable 
"s" from temperature of the sample is taken into consideration. 

For example, emissivity function of the heated object in spectral 
20 channel "i" can be represented as follows: 




(4) 




(XeAi) 



where: Sk'(T) - is a function reflecting dependency of the emissivity on 



temperature; 



Ek (a.)- is a function reflecting dependency of the emissivity on 



25 wavelength* 



K - is the preselected number of terms Sk'(T)* E k l ( X) 
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Behavior of the functions Sk'(T) and is assumed to be known ( i.e. the 
functions are selected in advance); parameters of the function Ek ( X) are also 
assumed to be known. 

Based on the above, the following system of N*M equations may be 
5 built and solved: 

'''' = X>;.(r,)*;W (6) 

where: 

R[(T.) = jE t k W*v'W*BU 9 T J )*dA (7) 

is integral of the preselected functions E, B and <p. 

Solving the system (6) permits derivation of M values of the sample 
io temperature, and N*K parameters for each of the functions Sk'(Tj). 

In yet another example, the above mentioned emissivity function Su'(Tj) 
may be expanded into a polynomial series, and the equation (5) will acquire 
the following form: 

15 where: 

b'kq = parameters of function SkOj) in the "i" spectral band; 
P'n(Ti) = polynomial of a pre-selected form and with pre-selected 
coefficients; 

(b'kq * P^Tj)) forms SktTj); 
20 Q - number of polynomial coefficients. 

The system of equations in this case will be as follows: 

rWss LI^*W)*^(r 7 ) ( 9) 

where: 
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i={i,N} ? j = {UM},k={t,K},q={l,Q}. 

Solution of the above system of N*M equations will give M unknown 
values of temperature, and N*K*Q parameters b 1 kq of the function Su'(Tj) (for 
the case when in each spectral band there is one and the same number of the 
5 parameters). 

[t should be emphasized that, knowing the above mentioned parameters 
and the functions Ek'(A.), one can exactly define the wavelength and 
temperature dependent function of emissivity. 

The above system of equations is linear for parameters bk q \ and 
i o non- linear for values of temperature Tj. 

Accuracy of the temperature calculations depends on the following 
parameters: 

number N of the spectral bands, and on specific selection of the 

bands, 

15 - number M of the "temperature" (i.e. electromagnetic radiation) 

measurements, 

quality of synchronizing of the "temperature" measurements in the 
N spectral bands, i.e. performing thereof (in the best case) substantially 
simultaneously, 

20 - technical parameters of radiometers and accuracy of the radiomet- 

ric measurements, 

accuracy of the mathematical model. 
Based on the above description and examples, the method of remotely 
measuring temperature of an object suggested in the present application 
25 represents also a method of determining emissivity function of the object. 

Fig. 3 illustrates a block-diagram of a system capable for 
implementing the inventive method. An object 10 (for example, a heated 
object) emits infrared radiation on to an optics 12 via which it is transmitted 
to a multichannel spatial filter 14. The multichannel spatial filter 14 performs 
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simultaneous splitting of spectral lines into N spectral bands. In Fig. 4a there 
is shown a schematic plan view 28 of the multichannel spatial filter which is 
designed to split the spectrum into N=12 spectral bands (channels) by 12 
zones capable to transmit radiation of different wavelengths. Practical 

5 implementation of the filter is not discussed in the frame of the present patent 
application. Intensities of the obtained N radiation portions are then detected 
by a detector 1 6 adapted for multichannel detection. "N" analogous readings 
of the electromagnetic radiation obtained by the detector 16 are converted into 
the digital form and transmuted to a processing unit 1 8 where they are stored 

io for further processing. 

All the above-described operations are synchronized by a control 
unit 20 of the processing unit 18, which generates M successive synchro- 
nizing signals. Each of these M signals simultaneously activates optics 12, 
multichannel filter 14, detector 16 and processing unit 18 for performing and 

1 5 recording one of the M measurements of the infrared radiation being effected 
simultaneously in N spectral bands. M*N obtained digitized readings of the 
infrared radiation emitted from the object 10 are processed in the unit 18 as a 
system of equations having at least M+P unknowns comprising M values of 
temperature of the object and at least P parameters of its emissivity model. 

20 Values of the temperature ( and/or of the emissivity), being solutions of these 
equations, are displayed by a display 22. If desired, the system can be adapted 
for deriving a temperature descriptive map of the object, as well an emissivity 
descriptive map thereof. To this end, optional thermal mapping unit 24 and 
an emissivity mapping unit are connected to the processing unit 18. Fig. 4b 

25 shows a filter structure suitable for making the mapping operation. 

Fig. 4b illustrates a plan view of a spatial filter 30 divided into a 
number of sites 32 for acquiring infrared radiation from a number of 
respectively located segments of the object (not shown). Each site has N=4 
zones responsible for splitting the infrared radiation acquired by the site into 
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four spectral bands. Plurality of the split radiation portions from ail sites of 
the filter 30 may be then transmitted to a detector similar to that shown as 16 
in Fig. 3, and further to a similar processing unit The processing unit will 
process the stored digitized information so as to produce values of 

5 temperature and/or emissivity associated with every one of the sites 32 of the 
Filter 30, for further composing a descriptive map of temperatures 
(emissivities) of the corresponding segments of the object. 

Geometric shape and parameters of the spatial filter 30 may be 
selected according to each specific application. 

10 Figs. 5 and 6 schematically illustrate a particular example of the 

inventive method for obtaining ternperaiure/emissivity maps of a selected 
region, with providing of further pattern recognition based on the obtained 
data. The particular example described below focuses on the detection of 
underground structures. It should be noted, however, that it applies mutatis 

15 mutandis to the detection of on ground as well as to above ground targets. 

Typically, the system used for passive remote sensing of the 
Earth's surface is a multi-spectral radiometer designed to operate in some 
convenient atmospheric window, e.g., between 8 and 12 u. The configura- 
tions and operation of such systems is well known to those skilled in the art 

20 (see. e.g., various articles appearing in: Proceedings of the First International 
Airborne Remote Sensing Conference and Exhibition, 12-15 September, 
1994, Strasbourg, France) and, therefore, will not be expounded upon herein. 
Similarly, the operation of pyranometers, for measuring optical radiation from 
the sky, is well known to those skilled in the art (Kondratyev. 1969, Radiation 

25 in the Atmosphere, 62, Academic Press) and, will also not be expounded 
upon herein. 

The detection of underground structures is performed by scanning 
the area of the Earth's surface under investigation a number of times, and 
extracting from the recorded data physical information characterizing heating 
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and cooling processes that take place not only at the Earth's surface but also 
below che Earth's surface. To this purpose an equation of thermal balance is 
used that contains information regarding heat transfer processes above and 
below the Earth's surface, through a set of therrnophysical constants. The 
5 information obtained is then processed by suitable statistical methods in order 
to detect regions having different thermal properties, in the region selected for 
scanning. These therrnophysical inhomogeneous regions are classified in a 
pattern recognition process in which the underground structures are identified. 



io pre-processing stage, in which temperature, emissivity and characteristic 
maps (maps of the therrnophysical constants and statistical derivatives 
thereof) of the selected region are produced and a pattern recognition stage in 
which the underground structures are detected. 



15 scans the area of the Earth's surface under investigation at at least one pixel at 
a time. The radiation received from each pixel by the radiometer, and by the 
pyranometer which receives radiation from the sky, serves as input for 
pre-processing software which computes characteristic maps of the selected 
region based on the Planck's equation, the albedo equation and the energy 

20 balance equation. 

A series of scans of the selected region are performed during a 
twenty-four hour period and the therrnophysical constants are extracted from 
the energy balance equation (10): 



The detection process is divided into two main stages: a 



To effect the pre-processing stage a multi-spectral radiometer 




25 --2L J-*, f(V(rj).Tjil)^T(i 1 ))di 1 
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+ JL)idTi (10) 

where. Tf jjj is the temperature of a pixel in the selected region at time 77 , To 
is the temperaaire of the pixel at the time, to, of the first scan of the series, 
TJ*]) is the temperature of the atmosphere in the vicinity of the selected 

5 region at time q , f(rj) is the radiance of the sun and the sky in the visible and 
near infra red region, J(rj) is the radiance of the sky and the sun in the region 
8 - 1 2 jli at time 77 , 
cr is Stefan Boltzman's constant, 
P is the thermal inertia. 

10 a is the coefficient of heat transfer, 
p is the coefficient of mass transfer, and 
O is the thermal flux for conduction. 

The energy balance equation (10) contains two functions, /and 
g that will be described below, and four unknown thermophysical constants, 

15 a ft Pztnd O that are to be computed at each pixel. Since, in the example 
chosen, of an underground structure, there are four unknowns, four equations 
are required to solve for them. The four equations are obtained by scanning 
the selected region five times during a twenty-four hour period. The first scan, 
performed at time t=0 gives rise to zero on the left hand side of equation (10) 

20 and is not used. The remaining four scans give rise to a set of four linear 
equations which can solved for the unknown thermophysical constants. Since 
the computations are performed for each pixel of the selected region the result 
is a set of maps, an a map, a p map, a P map and a Q map. 

As is well known to those skilled in the art, there are a number of 

2$ possibilities for the choice of the function / for a discussion of various 
possible choices see: Jakob. 1965, Heat Transfer. John Wiley & Sons. For 
example, for low wind speeds an expression for this function is given on page 
473. Eqn. (22-91), whereas for high wind speeds an appropriate expression is 
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given on page 555 by Eqn, (26-29)). In the present example, the following 

choice for the function / is made: 

/ = f 0. 064 + 0. 032 V( 7] ) Q S ) ( T a (rj) -T(t}) ) 

where. V(i] ) is the wind speed over the selected region at time t = 7 and the 
5 other variables are as defined above. This expression for the function / is 

valid for wind speeds less than 40 kilometers per hour. 

There are also a number of possibilities for the choice of the 

function g (see Rosema, 1975, "Simulation of the Thermal Behavior of Bare 

Soils for Remote Sensing Purposes" in: Report 11. Netherlands 
io Interdepartmental Working Community for the Application of Remote 

Sensing Technology, Delft, The Netherlands), in the present example the 

following choice is made: 

g(i?> = (ri - /. /•' 

where, t n is the time at which water starts to evaporate from the ground, at 
15 the selected region, due to heating by the sun. This time is normally defined 
as the time at which the sun makes an angle of 20° to the horizon during 
sunrise. y f and y : are constants that are determined empirically by performing 
control led measurements for given families of ground types. Once deter- 
mined, the values of y, and y 2 can be stored and used as required. In general 
20 the values of y f and y 2 depend on the humidity of the ground. It has been 
found that they have one substantially constant value, for relative humidities 
less than 12%. and another substantially constant value for relative humidities 
greater or equal than 12% and less than 30%. For example, for sand- based 
earth y f - 4.76 and y : ~ 0.72 for relative humidities of the ground less than 
25 12%. and y t = 4.61 and y 2 - 0.748 for relative humidities of the ground 
greater or equal than 12%. Detection of underground structures for relative 
humidities of the ground above 30% and for rainy conditions is not possible, 
lnfonnation on rain, clouds, the atmospheric temperature and wind speed is 
obtained from meteorological stations. 
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The computation of the thermophysical constants is summarized in Fig. 5. 
The radiation measured by the multi-spectral radiometer (block 41) along 
with relative humidity and atmospheric temperature readings (block 42) is 
conveyed to the computational process (block 43) which uses the 
5 above-described equation (4) and an albedo equation to compute the 
temperature (T), emissivity (e ) and albedo (A) maps, which are stored in the 
storage means (block 44). After the fifth scan in the twenty four hour period 
has been made, the T,e and A maps from the last four scans along with the 
time u and the wind speed V are conveyed to the computational process 

io (block 45). which uses the energy balance equation, to compute the maps of 
the thermophysical constants a,/3> P and Q. 

The pattern recognition stage is initiated by a process in which an 
optimal set of characteristic maps is determined. In addition to the a, p. P 
and Q maps, maps of the average, and of the variance, of a,j3, Pand Q are 

15 computed. The average and the variance are computed by standard statistical 
techniques (see. e.g., Tou and Gonzalez, 1974, Pattern Recognition 
Principles. Addison- Wesley Publishing Co. Inc.). In addition, texture maps 
for each of a. /?, P and O are computed. Texture maps can be computed in a 
number of ways (for a description of the concepts of image texture see. e.g., 

20 Haralick. 1982, "Image Texture Survey", in Handbook of Statistics, Krishniah 
and Kanal. editors. Vol. 2, 399), e.g., with aid of the computation of the two 
dimensional autocorrelation function according to the following equation : 
K*(pj = e** p cos(co 4 p) y 

where, p is a translational distance between pixels and 0 is a translational 
25 angle between the pixels, defined as the angle between the horizontal axis and 
the line joining the origin of the coordinate system to the pixel under 
consideration, a* and are constants of the autocorrelation function. As <p 
varies from 0° to 360° A* and take on a set of possible values, the 
parameters that describe the set of possible values of A* and co* are the 
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parameters that characterize the texture. Since the texture assists in the 
classification process it is important to have a fairly simple representation for 
the set of values it comprises. To this end, the envelope of the set of maximal 
values of x+ and co* is chosen to be an ellipse. In order then to characterize 
5 the texture, the parameters of the ellipse of the maximal values of X* and 
have to be computed. An ellipse is described by three parameters, its minor 
axis, its major axis and the orientation of the ellipse in the plane of its 
definition. All in all. to characterize the texture, seven parameters are 
required, three that characterize the ellipse of the maximal values of x* . three 

io that characterize the ellipse of the maximal values of and one for the angle 
between the axes of the two ellipses. Hence, seven texture maps are computed 
for each of the thermophysical constants a ,/3 ,P and O . Hence, initially 
twenty eight texture maps are required. The maps of a,p t P and O, and of 
their average and variance, and the texture maps of a,p, P and Q define a 

1 5 set of characteristic maps of the selected region. 

Areas of the selected region containing underground structures 
have surface temperatures that are very slightly different from those of the 
surroundings. These very slight temperature differences give rise to 
temperature maps of very low contrast in which it is difficult to distinguish 

20 between normal ground areas and those covering underground structures. The 
characteristic maps of the selected region serve to augment the temperature 
maps and to increase the contrast between these two types of grounds. Since 
there are a large number of maps and a large number of pixels per map, 
statistical methods are used for associating, or classifying, the pixels of the 

25 selected region with various backgrounds and targets therein. 

In the classification process the selected region is divided into 
classes. Initially the number of classes is as the number of pixels, however, in 
order for the pattern recognition process to be successful the number of 
classes should be representative of the number of types of different 
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backgrounds and targets, i.e., enquiry sectors, in the selected region. The 
classification process is carried out in two stages; the learning stage and the 
association stage. In the learning stage the number of classes in the selected 
region is determined, whereas in the association stage each of the pixels in the 
5 maps is associated with a class. To perform the classification a suitable 
statistical function describing the distribution of pixel values is chosen. For 
example, but by no means binding, a sum of weighted Gaussians, i.e. a 
poly-Gauss, can be chosen: 
P(s t^^coi NiiSi.s ) 
10 where: 

Ni( Si . 5 ) is the i th Gaussian in the sum, 

cos is the weight of the I th Gaussian in the sum, 

s is a vector whose components are the elements of the set of characteristic 
maps of the selected region. 
15 m is the number of classes, and 

it* * 

Si represents the parameters of the i Gaussian in the sum (for the properties 
of Gaussian distributions see - Tou and Gonzalez, ibid.). 

The learning stage consists of determining the values of m . co ( , 
and Si . or, if a different distribution is chosen, the equivalent parameters. 
20 and Si are chosen such that the poly-Gauss distribution density is maximal for 
a given vector s . The value of m is determined by including in the weighted 
sum only those terms for which : 
eo/Acoi < v, 

where, v is chosen optimally by trial and error to include enough terms in the 
25 sum so that the pattern recognition process is successful, whilst on the other 
hand it should be as small as possible so as to keep the computational 
complexity to a minimum. The error in computing &coi, is determined 
using Fisher's matrix (Rao, 1973. Linear Statistical Inference and its 
Application. Wiley). The value v=2 has been found to be optimal in a 



WO 99/27336 



-33- 



PCT/IL98/00S68 



number of pattern recognition experiments that where conducted. 

The association stage is performed by computing for each pixel, 
say [he i'\ the probability, p ik , that it belongs to class, le tor each class in the 
selected region, using, e.g., Bayes' equation (see, Roiston. Principles of 
5 Artificial Intelligence and Expert Systems Development, McGraw-HilL 99). 
The decision for associating the \ u pixel with the k* class is made by 
determining the maximal value of 
P., = Pik'Y &Pik, 

for a fixed value of i as k runs over all the classes. The error, Ap tJt , in 
io computing the probability, p ik , can be determined using Fisher's matrix (Rao, 
1973. ). The constant /, is determined empirically in controlled experiments 
by finding the minimum set of characteristic maps that enable target detection 
to a required degree of accuracy. For y = 0 the full set of characteristic maps 
has to be included in the pattern recognition process giving rise to maximum 
15 complexity in the computational process. In a certain set of controlled 
experiments it was found that l<y<3. Invariably, the choice y - 2 has been 
found to give good results for a minimal computational load. 
In the maimer described, the class to which each pixel belongs is determined, 
hence effecting the association stage and thereby completing the classification 
20 process. 

Having determined the value of /, a quality factor, Q(s ), is 
defined in order to effect the pattern recognition process: 
Q(s J = P- yAP 

where. P is the average probability of associating each element of a set to its 
25 class, and can be computed using Bayes theorem. A^. is the error in 
computing the probability P , and can be computed using Fisher's matrix. The 
constant /. is the same as that discussed in the foregoing. The pattern 
recognition process entails determining that set of characteristic maps that 
makes Q(s ) maximal. In other words the value of Q(s ) is a criterion for 
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the quality of the classification of the selected region. The process then is 
carried out as follows; choose a set of characteristic maps, perform the 
classification process and compute Q(s If 0(s ) is not close to the value 
1. then choose another set of characteristic maps, perform the classification 

5 process again and re-compute 0(s ). If the value of 0(s ) is close to 1, 
then an optimal set of characteristic maps has been found and the classifica- 
tion process is declared successful. If the value of Q(s ) is not close to 1, 
then the process is repeated until the classification process can be declared 
successful. An underground structure is then an anomaly in the selected 

io region, i.e.. any area in the selected region that does not belong to a defined 
class, is then declared to be an underground structure. Normally, the pattern 
recognition process starts off with a very large set of characteristic maps and 
the computational load is very heavy. In order to partially reduce the 
computational load, the pattern recognition process is performed with a 

15 priorly optimized set of characteristic maps. This optimization is achieved by 
performing a least squares calculation (see - Lawson and Hanson, Solving 
Least Squares Problems. Prentice-Hall) on 0(s ) using a weighted set of 
characteristic maps in order to find the relative weights of the characteristic 
maps in their contribution to Q (s ). Those characteristic maps having a small 

20 weight are discarded. 

Sometimes there may be prior information as to the form of the 
underground structures. In such an event the classification process can be 
enhanced and the anomalies in the selected region can be sorted by 
geometrical form, making the identification of an underground structure much 

25 more reliable. 

The pattern recognition process is summarized in Fig. 6. The 
complete set of characteristic maps is initially optimized at stage 46 using 
least squares. The initially optimized set of characteristic maps is then used to 
classify the pixels into classes (block 47), by performing the learning and 
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association stages as described above. The quality factor is then computed, at 
stage 48. and its value is checked, stage 49. If the value of the quality factor 
is not maximal, then a new set of characteristic maps is chosen from the 
initially optimized set of characteristic maps (process 50). Processes 47. 48, 
5 49 and 50 are continually performed until an optimal value for the quality 
factor is obtained, at the stage partem recognition is achieved (block 51). The 
pattern recognition process can also include an additional geometrical 
classification process for determining the shape of the detected object. This is 
particularly useful when detecting underground objects of a known shape. In 

io general, the anomalous region defining the underground object may be larger 
than the object to be detected, in which case distribution of the anomalous 
pixels can be studied for the known geometrical trends (for standard methods 
see Tou and Gonzalez, ibid). 

Fig. 7 schematically illustrates a system for obtaining 

15 temperature/emissivity maps of a selected object and further recognition of 
segments thereof based on the obtained maps and some additional parameters 
(such as thennophysical constants and metheorological data). An object 60 
(for example, a selected region on or above the earth) emits electromagnetic 
radiation on to an optics 62 via which it is transmitted to a multi-channel 

20 sequential filter 64 (for example, a rotational filter). The filter 64 produces N 
radiation portions in N respective spectral bands in sequence. Intensities of 
the obtained N radiation portions are then detected by a detector 66. "N" 
analogous readings of the electromagnetic radiation obtained by the detector 
66 are further converted into the digital form and transmitted to a processing 

25 unit 68 where they are stored for further processing. M*N obtained digitized 
readings of the radiation emitted from the object 60 are processed in the unit 
68 as a system of equations built according to formula (1). Values of the 
temperature (and/or the emissivity parameters or values), being solutions of 
these equations, are further transmitted to a pattern recognition processor 72 
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for building respective temperature and emissivity descriptive maps, per 
pixel, i.e. per segment of the object. However, data on the temperature and 
emissivity (if applicable) can be directly transmitted to display means 78 ? 
for optional indication. The pattern recognition processor 72 also receives 

5 meteorological and theirnophysical data schematically shown as block 80, 
and processes the temperature and emissivity data received from the 
processing unit 68 to produce a file 74 being a contrast descriptive map of 
the object and a file 76 being a classified image thereof. The contrast 
descriptive map 74 is a characteristic map based on a combination of the 

io temperature and emissivity descriptive maps, and the classified image 76 is 
a result of the pattern recognition processing based on the map 74 and the 
data 80. The display means 78 serves for graphical representation of the 
obtained files 74 and 76, The system illustrated in the drawing is adapted to 
obtain information on the electromagnetic radiation from the object 60 with 

15 the aid of a movable platform (such as a helicopter), and to process it. To 
this end. the control unit 70 of the processing unit 68 may receive data 
(schematically shown as block 82) on the velocity of the platform* s 
movement with respect to the object. The unit 68 is provided with software 
means capable of registering the descriptive maps of temperature and 

20 emissivity with the platform movement. All the above-described operations 
are synchronized by a control unit 70 of the processing unit 68, which 
generates M successive synchronizing signals per each segment of the 
ob ject 60. Each of these M signals simultaneously activates optics 62. filter 
64. detector 66 and processing unit 68 for performing and recording each of 

25 the M measurements of the radiation in N spectral bands in sequence. 



